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(54) A diffractive/refractive lenslet array incorporating a second aspheric surface 

(57) A short focal length image sensor comprising: 



a color photosensor array comprised of sets of 
three photosensors with red, green, and blue, filters 
positioned over respective photosensors in each 
set; 

a lenslet array corresponding in the number of lens- 
lets to the number of sets of photosensors in said 
color photosensor array, wherein each lenslet is 
formed with a first convex, spherical surface having 
diffractive means incorporated thereon and a sec- 
ond surface which is aspheric, substantially oppo- 
site said first surface with the size of said lenslet 



array being greater than the size of said photosen- 
sor array by an amount that allows the local optical 
axis of each lenslet at the largest field angle to 
image incident light onto the set of photosensors 
associated with the image sensors largest field 
angle; and 

an array of aperture stops combined with an array 
of field stops wherein the number of field and aper- 
ture stops corresponds to the number of lenslets 
and wherein each field and aperture stop is aligned 
to the center of the local optical axis for an associ- 
ated set of photosensors. 
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Description 

FIELD OF THE INVENTION 

5 This invention is related to the field of lenslet arrays for image sensors and particularly to the field of lenslet arrays 

which when combined with digital image sensors form an electronic representation of the optical intensity distribution 
at the focal plane of the lenslet array. 

BACKGROUND OF THE INVENTION 

10 

The minimum thickness of a camera is limited by the back focal distance of the camera objective. Focusing on dig- 
ital cameras, it is possible to make digital cameras thinner by using wide angle lenses, but this makes objects appear 
as a smaller fraction of the field of view than is desired in some instances. There is also a limitation of the lens 1/2 field 
angle to be less than 30 to 35 degrees below which it is much easier to correct for field dependent aberrations such as 

15 coma, astigmation, lateral color, petzval field curvature and lateral color. This field angle limitation limits how short the 
focal length of the objective can be and in turn how thin a camera can be. It is the object of the current invention to form 
a very thin camera using a novel type of array lens photographic objective. 

Lenslets arrays have been used concentrate light imaged on the detector plane by a photographic objective into 
smaller areas to allow more of the incident light to fall on the photosensitive area of the photodetector array and less on 

20 insensitive area between the pixels. This has been described in papers such as "Visible Array Detectors" by Timothy J. 
Tredwell, from Handbook of Optics, Vol. 1, Fundamentals, Techniques, & Design, Second Edition, Chapter 22, pp. 
32-34. These lenslet arrays are centered directly above the corresponding photosensor and are not designed to look at 
different portions of the field of view independently. Rather, they concentrate the light from an existing image formed by 
the photographic objective into the pixel aperture. 

25 In U.S. Patent No. 4,994,664, entitled, "Optically Coupled Focal Plane Arrays Using Lenslets And Multiplexers" by 
Veldkamp, an array of diffractive lenslets is used to concentrate incident light onto an array of photosensors in order to 
allow for location of amplifying circuitry in areas between photosensor sites. These lenslets are centered over the pho- 
tosensitive sites and are formed on the opposite side of the photosensor array on a silicon substrate, the use of the sil- 
icon substrate prevents them from imaging visible light onto the photosensors since silicon does not transmit in the 

30 visible wavelengths. This invention also would not be able to work over the visible wavelength range since the element 
is composed of all diffractive optical power and suffers from severe chromatic aberrations. 

In U.S. Patent No. 5,233,1 74, entitled, "Wavefront Sensor Having A Lenslet Array As A Null Corrector" by Zmek, an 
array of diffractive lenslets with decenters which are adjusted to eliminate the local monochromatic wavefront tilt from a 
specific optic under test in an interferometric or Hartman type test. A Hartman test is used to certify the surface quality 

35 of various optics. If the optics under test falls within the acceptance criteria the wavefront incident on the sensor array 
will form centered light spots on predetermined pixels. If the wavefront is other than the desired wavefront the light spots 
will be incident on different pixel elements. This invention is not applicable to the current application since the centered 
lenslets are not looking at regularly spaced sections of a predetermined field of view. It is also not applicable to white 
light applications due to the chromatic aberrations of the diffractive lenslets. 

40 U.S. Patent No. 5,340,978, entitled, "Image-Sensing Display With LCD Display Panel And Photosensitive Element 
Array" Rostoker et al., briefly describes an array of decentered lenses which form an image of a segment of the field of 
view is described. These lenses are widely separated and do not include a workable method for limiting a field of view 
seen by an individual pixel. Light from outside the desired field of view can be incident on the photosensor by scattering 
off the walls of a spacer element or by reflection and reimaging of light within the array substrate. The wide separation 

45 of the lenslets in the array limits the amount of light which can be gathered and focused on the image sensor. The use 
of the widely separated pixels will greatly increase costs of the sensor since there will be fewer sensor arrays fabricated 
on a given size substrate or wafer. In addition, the larger sensor array size will cause a decreased yield of finished sen- 
sor arrays for a given manufacturing process. Also there is no discussion of the trade-off between the focal length of the 
lens array and the angular subtense of the pixels field of view. If the focal length of the lenslets is to short light from one 

so part of the field of view which is incident on one pixel will also be within the field of view of an adjacent pixel. For very 
short focal lengths the corresponding pixel dimension required for an equivalent angular resolution will be so small as 
to not be able to be fabricated with lithographic processes. In addition, the light gathering area of the pixel will be so 
small as to not generate a reliably measurable number of electrons for a given incident intensity. There is no discussion 
of the use of diffractive/refractive hybrids for achromatization. In the current invention the lenses will be abutted to each 

55 other and an opaque baffle placed over the sensor to limit the field of view of each pixel. 

SUMMARY OF THE INVENTION 

The present invention is directed to overcoming one or more of the problems set forth above. Briefly summarized, 
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according to one aspect of the present invention, there is provided a short focal length image sensor comprising: 

a color photosensor array comprised of sets of three photosensors with red, green, and blue, filters positioned over 
respective photosensors in each set; 

5 a lenslet array corresponding in the number of lenslets to the number of sets of photosensors in said color photo- 

sensor array, wherein each lenslet is formed with a first convex, spherical surface having diffractive means incorpo- 
rated thereon and a second surface which is aspheric, substantially opposite said first surface with the size of said 
lenslet array being greater than the size of said photosensor array by an amount that allows the local optical axis 
of each lenslet at the largest field angle to image incident light onto the set of photosensors associated with the 

10 image sensors largest field angle; and 

an array of aperture stops combined with an array of field stops wherein the number of field and aperture stops cor- 
responds to the number of lenslets and wherein each field and aperture stop is aligned to the center of the local 
optical axis for an associated set of photosensors. 

15 From the aforementioned it can be seen that it is a preferred object of the present invention to provide a lenslet 
array for an image sensor with a wide field of view and a short back focal distance. 

It is another object of the present invention to provide an improved lenslet array for use in a compact semiconductor 
image sensor assembly that is easy to fabricate and that enables the design and manufacture of cameras thinner than 
heretofore possible. 

20 These and other aspects, objects, features, and advantages of the present invention will be more clearly under- 
stood and appreciated from a review of the following detailed description of the preferred embodiments and appended 
claims, and by reference to the accompanying drawings. 

Advantageous Effect Of The Invention 

25 

The present invention has the following advantages: 

The present lenslet array sensor is compact and portable due to its reduced lens backfocus which permits its use 
in very thin camera bodies; 

30 sensors incorporating the lenslet array of the present invention are easy to fabricate with minimum critical align- 
ments of parts in that multiple integrated sensor arrays on a semiconductor wafer may be simultaneously aligned 
with multiple lenslet arrays before dicing of the wafer. 

BRIEF DESCRIPTION OF THE DRAWINGS 

35 

Figs. 1A and 1B are a front and a rear perspective view of a lenslet formed in accord with the teachings of the 
present invention; 

Fig. 2 is a sectioned view taken along the section lines A-A of the lenslet of Fig 1 B; 

40 

Figs. 3A and 3B illustrates an aperture array positioned over a lenslet array with the spherical surface of each lens- 
let defined with topographical lines with the lenslets physical centers diverging with respect to photosensor centers 
in 3 A and converging with respect to the photosensor centers in 3B; 

45 Fig. 4 illustrates, in a cross section view, an image sensor in accordance with the teachings of the present invention 
having an array of field stops and an array of aperture stops positioned in front of a lenslet array and photosensor 
array; and 

Fig. 5 illustrates, in a cross section view, an image sensor in accordance with the teachings of the present invention 
so having an array of field stops positioned in front of a lenslet array and photosensor array and an array of aperture 
stops positioned between the lenslet array and the photosensor array; 

Figs. 6A, 6B, and 6C, illustrate a cross section of, the portion of a lenslet associated with a 0 degree field angle, the 
associated tangential, and saggital ray aberration curves, respectively; 

55 

Figs. 7A, 7B, and 7C, illustrate a cross section of, the portion of a lenslet associated with a 14 degree field angle, 
the associated tangential, and saggital ray aberration curves, respectively; and 

Figs. 8A, 8B, and 8C, illustrate a cross section of, the portion of a lenslet associated with a 20 degree field angle, 
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the associated tangential, and saggital ray aberration curves, respectively. 

To facilitate understanding, identical reference numerals have been used, where possible, to designate identical 
elements that are common to the figures. 

5 

DETAILED DESCRIPTION OF THE INVENTION 

Referring to Figs. 1 A and 1 B, The lenslet 10 is one element of a lenslet array that is formed with a number of lens- 
lets. Each lenslet 10 is formed with a diffractive surface 18 formed on a refractive, spherical surface 20. Opposite the 

10 diffractive surface 18 is a second surface 22 that is an aspheric surface. The faceted surface of the diffractive surface 
18 is seen more clearly in the cross-section of Fig. 2. At a radius 14 the second surface is convex and transforms to a 
concave surface at the radius 12. The second surface 22 defines a polynomial asphere which exhibits an inflection at 
the radius 1 6. Both the first and the second surfaces are substantially perpendicular to the optical axis 24 of the lenslet 
10. The lenslet 10 may be formed of optical glass such as BK7, quartz, injection molded plastic, or an epoxy replica. 

15 Referring to Fig. 2, incident light rays 30 pass through an aperture stop array 40 and are focused onto a focal plane 
50 by the lenslet 10. The diffractive/refractive surface comprised of 1 8 and 20 correct the chromatic aberrations and pro- 
vide the majority of the focusing power while the aspheric surface 22 provides for correction of field dependent aberra- 
tions such as petzval curvature, astigmatism, and coma. The lens has an F# of 2.0 and a FL of 0.5mm, but generally 
could be from 0.4 to 2.0mm FL. 

20 Referring now to Figs. 3A and 3B, The individual lenslets 10 of Figs. 1 and 2 are segmented and formed into a lens- 
let array 60. The lenslet array 60 is formed with the lenslets 10 being associated with corresponding photosensor sites 
72 (shown more clearly in Fig. 4). To be observed in Figs. 3A and 3B is that the center of the optical axis 24 of each 
lenslet 1 0 is displaced outward as a function of its radial distance from the optical axis of the central lenslet while in Fig. 
3B, the optical axes are displaced inward. The lines 15 appearing around the optical axis 24 of each lenslet 10 are top- 

25 ographical lines generally indicating changes in height of the lenslet's surface. An array of aperture stops 26 fills the 
areas between the lenslets 1 0 to prevent light from reaching the sensor that will be discussed with respect to Fig. 4. The 
array depicted in Figs. 3A and 3B represent only a small portion of an array that would be used in an actual camera. In 
an actual implementation approximately 260 X 21 4 to 1 500 x 1 000 lenslets are used to form the array 60. This invention 
does not form the lenslet array with the optical axis of each lenslet, and in turn the lenslet itself, aligned directly over a 

30 respective photosite in the CCD device. Instead the lenslets are displaced so as to form the image on a regularly 
spaced array of photosensors Other configurations of the lenslets may be used such as forming the outer periphery of 
each lenslet as a square, hexagon, or circle, without detracting from the invention. 

The reason that the invention uses only portions of the lenslets is that only a fraction of the lenslet is used for a par- 
ticular angular field of view for an associated pixel of the group of three pixels for the color application. 

35 Figure 4 is a cross-section taken along the section line 4-4 in Figs. 3A and 3B, illustrating the lenslet array 60 posi- 
tioned over an image photosensor array 70 that may be a CCD array having a number of photosensitive sites 72 corre- 
sponding in number to at least the number of lenslets forming the array 60. In a three color environment up to three 
photosensitive sites would be formed under each corresponding lenslet. The lenslet array 60 is maintained a distance 
apart from the surfaces of the photosensors by spacers 74 that may also serve the function of being baffles. The aper- 

40 ture stop array 40 in combination with the baffles 74 and the field stop array 42 limit the field of view of any particular 
photosensor so that it does not overlap the field of view of it neighbors by a large amount. The field stop array 42 is posi- 
tioned approximately 0.5mm to 2mm from the surface of the lenslet array 60. 

The center of the apertures in the aperture stop array and field stop array, 40 and 42, respectively are aligned to 
the center of the field of view of a corresponding lenslet. The spacing of the centers increases as a function of each 

45 lenslet's field angle from the center of the array causing the aperture stop array to be slightly larger than the associated 
lenslet array. The combination of the aperture stop array 40 with the field stop array 42 and a given lenslet focal length 
determines the field of view for a photosensitive site 72. 

The lenslet array 60 can be formed of etched quartz, or an epoxy replica on a glass substrate. 

The lenslets 10, combined with the appropriate field and aperture stop form images of a small segment of the field 

so of view on photosensitive site 72. The light incident on a lenslet 10 is concentrated onto the active pixel area. 

The lenslet positions are adjusted to allow light imaged by the lenslet from a given field of view to be incident onto 
a given pixel. Since each CCD pixel has its own lens element there is no need to reinvert the image with a relay lens. 
Therefore, any camera system incorporating the present invention can be extremely compact and flat. The camera can 
work in black and white or in color if three pixels with color filters are formed on each pixel are used. 

55 An array of aspheric lenslets can be used to form images on the detector array. However, the aforementioned 
embodiment does not correct for the variation in focal length as a function of wavelength since the lens element is 
formed from a single refractive material therefore the spot size of the incident light varies as a function of color. An 
improved optical design including a diffractive/refractive hybrid lens is used to correct the chromatic aberration in a sin- 
gle material. 
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The imaging properties of diffractive and holographic optics are strongly wavelength dependent. When modeling a 
diffractive optic this phenomena can be represented as a direct dependence of equivalent refractive index on wave- 
length: 

5 n(X)=[X c A](n c -1)-1 

Diffractive elements impart all of their wavefront bending in an extremely thin layer. This is accounted for in the 
Sweat model by modeling the diffractive as a very high index material (n c = 1 0,000) with very low curvatures (weak sur- 
faces) on each surface. The corresponding focal length can then be determined from: 

10 

f(X)=[n(X)-1]Ac 

so that 



15 f(X)=(V^) f c 

where a c = design center wavelength 

The resultant dispersion v diff of the diffractive element is: 

20 n(X c )-1 

Vdiff n(*J-n(XJ 



which reduces to: 

25 

V cliff - i 

Aq A|_ 



30 For designs using: 



35 



45 



X c = 587 nm 



a s = 486 nm v d = -3.5 

v L = 656 nm 



For other wavelength bands of interest an appropriate n diff and element power distribution can be calculated. The 
direct dependence of the equivalent refractive index on wavelength leads to a small, negative, n diff and a high level of 
40 wavelength dispersion associated with a first order (m = 1) diffractive optical element. 

Due to the variation of refractive index with wavelength a single element lens has a variation of focal length with 
wavelength. Two materials with different dispersions can be used to form a doublet lens which has the same focal length 
at two wavelengths and reduced variation over the whole spectrum. The relative distribution of focal powers required to 
achieve this is given by 



*ref = 



v ref*^ total 
v ref v diff 



50 . v diff* ( l ) total 

' diff . . _ x . 

v diff v ref 



The negative n diff of the diffractive surface allows for achromatization of single element hybrid refractive / diffractive 
55 lenses utilizing a positive focal length diffractive and refractive component. It also decreases the focal length and F/# 
required of the doublet component lenses because a refractive doublet consists of a positive crown (low dispersion) 
lens with a shorter focal length and smaller F/# than is required for a single element lens and a negative flint element 
which increases the doublet focal length to the correct value and compensates for the dispersion of the positive lens. 
This effect also decreases the size and weight of the positive element of a hybrid refractive / diffractive element. 
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For traditional achromatization in the visible regime (d-e-f lines) with PMMA plastic lenses the fraction of power in 
the refractive and diffractive portions would be 

* ref/* total = 94.25% 

5 

* diff 7 ♦ total =5.75% 

It is obvious to a person skilled in the art that one can utilize substrates such a quartz, or optical glass such as BK7, 
or utilize epoxy replicas on glass substrates. 
10 The use of diffractive/refractive hybrid achromatization enables the use of diffractive surfaces with longer focal 
lengths and higher F/#'s. The high F/# makes the diffractive element easier to manufacture due to the large zone spac- 
ings. For instance for a lens with a FL = 0.5 mm and a F/# = 2.0 the first order analysis of the refractive and diffractive 
portions would provide focal lengths and F/#'s of 

15 f ref =0.531 mm F/# = 2.12 

f diff = 8.696 mm F/# = 34.8 

Assuming the diffractive portion of the lenslet was used purely for first order chromatic correction. 
20 The diffractive lenslets 10 are shown in Figs. 6A, 7A, and 8A, for the on-axis, 16 degrees, and full field of view. To 
be noted in a comparison of these figs is that the mechanical optical axis 14 is moving radially outwards as a function 
of field angle while the local optical axis 15 is incident normal to the plane of the photodetector array. 

The opaque mask 16 acts as the aperture stop for the system as well as limiting the field of view of a given photo- 
sensor 

25 Figs 6B, 6C, 7B, 7C, 8B, and 8C represent the tangential and saggital ray aberration curves for their respective 
lenslets. It is noteworthy that the overall spot size, including chromatic aberration, is approximately 10 microns which is 
a typical photodetector size. The solid lines represent a wavelength of 546.1 nm, the dotted lines represent a wave- 
length of 656.1 nm, and the dotted and dashed lines represent a wavelength of 460.0 nm which represent light in the 
green, red, and blue, wavelengths. 

30 The following table lists the optical design parameters for three array elements at 0, 1 6, and 26 degrees. The array 
elements at the intermediate field angles can be interpolated from these values. 

Example A 

35 EFL = 0.5 mm 

F/# = 2.0 
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10 



20 



Surface No. 


Radius 


Thickness 


Glass 


Object 




Infinity 


Air 


1 Aperture Stop 




0.282 


Air 


2 


0.38911 


0.5 


BK7 






Diffractive Coefficients 


DF1 = -6.861 x 10" 2 
DF2 = 6.568 x 10 _1 
DF3 = 3.453 x 10 s 
DF4 = -1.435 x10 2 
DF5= 1.398x10 3 


3 


-0.50499 


0.25715 


Air 


Aspheric Coefficients 


AD = 0.18542 x10 2 
AE = -0.44635x10 3 
AF = 0.10191 x10 5 
AG = -0.70929x10 5 
AH = 0.78203 X 10 5 






Image 






Air 



25 

where the aspheric surface profile is defined by 

2 

30 z(r) = Cvr + AD r 4 + AE r 6 + AF r 8 + AG r 1 0 

1+7l-(k+1)cv 2 r 2 

and the diffractive phase profile is defined as 

4>(r) = P(DF, r 2 + DF 2 r 4 + DF 3 r 6 + DF 4 r 8 + DF 5 r 10 ) 

where 

40 

X 0 = 546.1 nm 

The invention has been described with reference to a preferred embodiment. However, it will be appreciated that 
variations and modifications can be effected by a person of ordinary skill in the art without departing from the scope of 
45 the invention. 



PARTS LIST: 



10 


lenslet 


50 12 


radius 


14 


radius 


15 


lines 


16 


radius 


18 


diffractive surface 


55 20 


refractive, spherical surface 


22 


second surface 


24 


optical axis 


26 


aperture steps 


30 


incident light rays 
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40 aperture stop array 

42 field stop array 

50 focal plane 

60 lenslet array 

5 70 image photosensor array 

72 photosensitive sites 

74 baffles 

Claims 

10 

1 . A short focal length image sensor comprising: 

a color photosensor array comprised of sets of three photosensors with red, green, and blue, filters positioned 
over respective photosensors in each set; 

15 a lenslet array corresponding in the number of lenslets to the number of sets of photosensors in said color pho- 

tosensor array, wherein each lenslet is formed with a first convex, spherical surface having diffractive means 
incorporated thereon and a second surface which is aspheric, substantially opposite said first surface with the 
size of said lenslet array being greater than the size of said photosensor array by an amount that allows the 
local optical axis of each lenslet at the largest field angle to image incident light onto the set of photosensors 

20 associated with the image sensors largest field angle; and 

an array of aperture stops combined with an array of field stops wherein the number of field and aperture stops 
corresponds to the number of lenslets and wherein each field and aperture stop is aligned to the center of the 
local optical axis for an associated set of photosensors. 

25 2. The short focal length image sensor according to Claim 1 wherein the second surface of each lenslet is an aspheric 
surface that is convex at the lenses physical center and transitions to a concave surface towards the edge of the 
lens. 

3. The short focal length image sensor according to Claim 1 wherein said array of aperture stops is positioned in front 
30 of said lenslet array. 

4. The short focal length image sensor according to Claim 1 wherein said array of aperture stops is positioned 
between said lenslet array and said array of photosensors. 

35 5. The short focal length image sensor according to Claim 1 wherein the lenslets of said array of lenslets are abutting. 

6. The short focal length image sensor according to Claim 1 wherein each lenslet is positioned in said array so as to 
view a different fraction of the total field of view of the image sensor. 

40 7. The short focal length image sensor according to Claim 1 and further comprising a plurality of baffles extending 
between each lenslet and an associated set of photosensors for preventing stray light from an adjacent lenslet 
impinging on the associated set of photosensors. 
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50 



55 
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FIG. 1A 
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FIG.3B 26 
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